Image display device

ABSTRACT

An image display device easily displays a stereoscopically two-dimensional image and improves its direction effect and interactivity. A display device is included of a display element for displaying an image on a screen, an image transmission element that is set in a light path for a display light component of the image and that transmits the display light component of the image so that a real image of the image is displayed on an image forming surface positioned at a space on a side opposite to the screen as a stray image. The display device includes a property specifying element for specifying a property of a detected object positioned in a real space portion including the space where the stray image is displayed and a control element for controlling the display element so the stray image changes into a form corresponding to the specified property of the object in advance.

TECHNICAL FIELD

The present invention relates to an image display apparatus forstereoscopically displaying a two-dimensional image on the basis of a 3D(Dimension) floating vision method, for example.

BACKGROUND ART

This type of stereoscopic two-dimensional image can improve a realisticsensation, visibility, amusement, and the like in interior decorations,promotion displays, communication terminal apparatuses, game equipment,and the like. Hence, various methods for displaying the stereoscopictwo-dimensional image have been suggested. For example, a polarizationmethod is suggested in which a viewer wears polarized glasses and viewsright and left parallax images based on mutually different polarizationstates. However, this method may cause such a problem that it isbothersome for the viewer to wear the polarized glasses.

In order to deal with the problem, for example, a lenticular lens methodhas been suggested as a stereoscopic image display method which does notuse the polarized glasses (e.g. refer to a patent document 1). Accordingto this method, a plurality of screens are hidden in one screen, and theplurality of screens are shown through a transmissive screen, obtainedby connecting semicircular-column-type lenses of a certain width in ahorizontal direction, to thereby realize stereoscopic representation andmotion-picture representation.

Alternatively, the 3D floating vision method has been suggested by thepresent inventors. According to this method, by providing atwo-dimensional image as a real image by a microlens array, it ispossible to display a stereoscopic two-dimensional image in a relativelysimple structure. In particular, in order to realize an interactiveapparatus in this method, a technology has been suggested that uses aposition detection sensor to change a stereoscopic two-dimensional imagedisplayed on an image formation surface in accordance with an outputsignal from the position detection sensor (e.g. refer to a patentdocument 2).

-   Patent Document 1: Japanese Patent Application Laid Open No. Hei    10-221644-   Patent Document 2: Japanese Patent Application Laid Open No.    2005-141102

DISCLOSURE OF INVENTION Subject to be Solved by the Invention

However, for example, in the technology disclosed in the patent document1, there is the following problem in terms of cost; namely, in theaforementioned lenticular lens method, the plurality of screens arehidden in one screen, and therefore, it requires the parallax imagescorresponding to the both eyes of the viewer from the imaging stage.Moreover, in order to supply the images, many operations are required:for example, computer image processing, lenticular lens designing, andan operation of accurately combining the lenses and the images. Thiscauses high cost.

Alternatively, according to the technology disclosed in theaforementioned patent document 2, the problem in cost associated withthe patent document 1 can be solved and a certain degree of renderingeffect and interactivity are ensured; however, there is still room forimprovement in the rendering effect and interactivity. For example, atoy gun, a knife, a fork, a dryer, a brush, and the like have mutuallydifferent attributes (shapes, applications, functions, or the like) inreality; however, if only the same reaction is provided regardless ofwhich tool to be used to operate the image display apparatus, it is notinteresting and it is hardly said that the rendering effect andinteractivity are sufficient.

In view of the aforementioned problems, it is therefore an object of thepresent invention to provide an image display apparatus which displays astereoscopic two-dimensional image, relatively easily, and which canimprove the rendering effect and interactivity.

Means for Solving the Subject

The above object of the present invention can be achieved by an imagedisplay apparatus provided with: a displaying device for displaying animage on a screen; an image transmitting device which is disposed on anoptical path of display light which constitutes the image and whichtransmits the display light which constitutes the image so as to displaya real image of the image as a floating image on an image formationsurface located in a space on an opposite side to the screen; anattribute specifying device for specifying an attribute of a detectedobject located in a real space portion including the space; and acontrolling device for controlling the displaying device to change thefloating image into a form which is associated with the specifiedattribute of the detected object in advance.

According to the present invention, as described later, it is possibleto display the stereoscopic two-dimensional image, relatively easily,and it is also possible to improve the rendering effect andinteractivity.

In other words, firstly, the image is displayed on the screen by thedisplaying device such as a color liquid crystal display apparatus.

Here, the image transmitting device including e.g. a microlens array isdisposed on the optical path of the display light which constitutes theimage. By this image transmitting device, the display light whichconstitutes the image is transmitted and displayed as the floating imageon the image formation surface in which the real image is located in thespace on the opposite side to the screen. The “floating image” herein isan image which looks as if it were floating in the air from a userlocated at the observation position (i.e. in the range of user's viewangle), and it is preferably the real image. For example, it includessuch an image display method as a 3D floating vision (registered trademark of the present inventors) method or an integral photography method.

By the way, even if an operation is performed on the floating image asdisplayed above with a tool, such as a toy gun, a knife, a fork, adryer, and a brush, if only the same reaction is provided, it is notinteresting and it is hardly said that the rendering effect andinteractivity are sufficient.

According the present invention, however, the attribute of the detectedobject located in the real space portion including the aforementionedspace is specified by the attribute specifying device. The “detectedobject” herein is typically an instrumental object having someattribute, and it includes a toy gun or a fork, for example. The“attribute” of the detected object is a unique property orcharacteristic provided for the detected object itself, and itconceptually includes a shape, a function, a concept, and the like. Theattribute of the detected object is specified by being detected by theattribute detecting device, which is one example of the attributespecifying device described later.

Then, the displaying device is controlled by the controlling deviceincluding, for example, a recording circuit and an arithmetic circuit,to change the floating image into the form which is associated with thedetected attribute of the detected object in advance. For example, aform that “a character depicted in the floating image is scared” isassociated in advance with the attribute of the toy gun, which is a toolfor “opening fire”. Alternatively, a form that “pasta is displayed on aplate depicted in the floating image” is associated in advance with theattribute of the fork, which is a tool for “sticking and rolling food”.As described above, in accordance with the detected attribute of thedetected object, the floating image is changed into various forms whichcan be derived from the attribute.

Therefore, according to the present invention, it is possible to displaythe stereoscopic two-dimensional image, relatively easily, and it isalso possible to improve the rendering effect and interactivity.

In one aspect of the image display apparatus of the present invention,the attribute specifying device has an attribute detecting device fordetecting the attribute.

According to this aspect, the attribute of the detected object isdetected by the attribute detecting device in the following manner;namely, the IC tag in which the attribute is recorded in advance isattached to the detected object, and the IC tag is read by an IC tagreader in an electromagnetic-optic manner, to thereby detect theattribute of the detected object. Alternatively, pattern recognition isperformed on the image of the detected object imaged by an imagingapparatus such as a CCD camera and a database of candidate images of thedetected object, and the attribute recorded in association with thecandidate of the detected object is read, to thereby detect theattribute of the detected object.

In another aspect of the image display apparatus of the presentinvention, the image display apparatus is further provided with aposition detecting device for detecting where the position of thedetected object is in the real space portion, and the controlling devicecontrols the displaying device to change the floating image into a formwhich is also associated with the detected position of the detectedobject in advance, in addition to the specified attribute.

According to this aspect, as described later, it is also possible todramatically improve reality in addition to the rendering effect andinteractivity. In other words, firstly, where the position of thedetected object is in the real space portion is detected by the positiondetecting device such as an XYZ sensor, a CCD image sensor, an infraredsensor, or an ultrasound sensor. The “position of the detected object”herein includes not only a planar position of the detected object butalso a spatial position. For example, if the detected object crosses theimage formation surface or planes before or behind the image formationsurface, a planar area occupied by the detected object may be detectedin the image formation surface or the planes before or behind the imageformation surface. In addition to or instead of the planar areas, if thedetected object is located in the real space portion including theaforementioned space, a spatial area occupied by the detected object inthe real space portion may be detected. Then, the displaying device iscontrolled by the controlling device to change the floating image intothe form which is also associated with the detected position of thedetected object in advance, in addition to the specified attribute ofthe detected object. For example, if a “toy bullet” passes through a“floating image of a target”, the displaying device is controlled by thecontrolling device to change the “floating image of the target” to a“floating image of a target with a bullet hole”. As described above, thefloating image is dynamically changed in accordance with the position ofthe detected object, so that it is possible to improve the renderingeffect and interactivity. In addition, at this time, the “bullet hole”is not located at an arbitrary position but adjusted to a position where“toy bullet” penetrates, so that it is possible to dramatically improvereality.

In an aspect in which the position of the detected object is detected,the image display apparatus may be further provided with a memory devicefor storing a track of the position of the detected object changed, ifthe detected position of the detected object changes with time, and thecontrolling device may control the displaying device to change thefloating image into a form which is also associated with the storedtrack of the position of the detected object in advance, in addition tothe specified attribute.

According to this aspect, as described later, it is also possible todramatically improve reality in addition to the rendering effect andinteractivity. In other words, firstly, if the detected position of thedetected object changes with time, the track of the position of thedetected object changed is stored by the memory device, which is formedof an arithmetic-logic circuit, centered on a memory apparatus, forexample, every several hundred milliseconds. The “track of the positionof the detected object changed” herein includes not only a planarposition of the detected object but also a spatial track. In addition,it may indicate a track that satisfies a predetermined condition, suchas a track when the detected object crosses the image formation surfaceor the planes before or behind the image formation surface. Then thedisplaying device is controlled by the controlling device to change thefloating image into the form which is also associated with the storedtrack of the position of the detected object in advance, in addition tothe specified attribute of the detected object as described above. Forexample, if a “floating image of an apple” is vertically cut with aknife with it crossing the image formation surface, the track of thecutting is stored. Then, the displaying device is controlled by thecontrolling device to change the “floating image of the apple” to a“floating image of an apple with a cut” which is associated in advancewith the attribute of the knife. At this time, the “cut” is not locatedat an arbitrary position but adjusted to a position where the knifepenetrates. Moreover, since the track is stored, it does not vanish whenthe position of the knife is changed. Thus it is possible todramatically improve reality.

In an aspect in which the track of the position is stored, the imagedisplay apparatus may be further provided with a predicting device forpredicting where the position of the detected object is changed to inthe real space portion, on the basis of the stored track of the positionof the detected object, and the controlling device may control thedisplaying device to foresee the image in a form which is alsoassociated with the predicted position of the detected object inadvance, in addition to the specified attribute.

According to this aspect, as described later, it is possible to improvethe rendering effect and interactivity, and it is also possible to solvea response delay in displaying the floating image. In other words,firstly, the track of the position of the detected object changed asdescribed above is stored by the memory device, for example, everyseveral hundred milliseconds. Then, where the position of the detectedobject is changed to in the real space portion after the time point thatthe position of the detected object is detected (typically the newestdetection in detecting the position a plurality of times) is predictedby the predicting device which is formed of an arithmetic circuit, onthe basis of the stored track of the position of the detected object.For example, by specifying a velocity vector on the basis of the trackof the position of the detected object stored with time, it is alsopossible to predict the subsequent track. Then, the displaying device iscontrolled by the controlling device to foresee the image in the formwhich is also associated with the predicted position of the detectedobject in advance, in addition to the specified attribute of thedetected object. As described above, it is possible to solve theresponse delay by predicting the displacement of the position not onlyfrom the current position of the detected object but also from the trackand by foreseeing the image in advance in accordance with the predictionresult. As a result, it is possible to reduce a sense of discomfort,such as a later-coming change in the floating image or changing a littlebehind the displacement of the detected object.

In another aspect of the image display apparatus of the presentinvention, the image display apparatus is further provided with a statusdetecting device for detecting a status of the detected object, and thecontrolling device controls the displaying device to change the floatingimage into a form which is also associated at least with the detectedstatus of the detected object in advance, in addition to the specifiedattribute.

According to this aspect, as described later, the floating image ischanged in accordance with the status of the detected object or itschange, so that it is possible to further improve the rendering effectand interactivity. In other words, firstly, the status of the detectedobject is detected by the status detecting device. The “status of thedetected object” herein qualitatively or quantitatively indicates sonicstatus about the detected object. For example, it indicates adiscontinuous two-step status, such as the ON/OFF of a switch, acontinuous multistage status, such as low, middle, and high volume, orsimilar statuses. Then, the displaying device is controlled by thecontrolling device to change the floating image into the form which isalso associated at least with the detected status of the detected objectin advance, in addition to the specified attribute of the detectedobject. For example, if the switch of the toy gun is changed from OFF toON, it is regarded as opening fire, and the displaying device iscontrolled by the controlling device to change the “floating image ofthe target” to the “floating image of the target with the bullet hole”.Alternatively, if the switch of a dryer is changed from OFF to ON, a“floating image of a woman with long hair” may be changed to a “floatingimage of a woman with flowing hair”, which is associated in advance withthe attribute of the “dryer”. As described above, the floating image isdynamically changed in accordance with the status of the detectedobject, so that it is possible to further improve the rendering effectand interactivity.

In another aspect of the image display apparatus of the presentinvention, the image display apparatus is further provided with a tagdevice which is attached to the detected object and in which attributeinformation indicating the attribute of the detected object is recordedreadably in an electromagnetic-optic manner, and the attribute detectingdevice detects the attribute by reading the recorded attributeinformation in an electromagnetic-optic manner.

According to this aspect, as described later, the attribute informationabout the detected object can be read by using the tag device, and therendering effect and interactivity can be improved on the basis of theread attribute information. In other words, firstly, the tag device suchas an IC tag or a barcode is attached to the detected object. In the tagdevice, the attribute information which indicates the attribute of thedetected object is recorded readably in an electromagnetic-optic manner.The expression “readably in an electromagnetic-optic manner” hereinindicates that the attribute information recorded in the tag device canbe read using electricity, magnetism, or light. Then, the attributeinformation is read in an electromagnetic-optic manner by the attributedetecting device, such as an IC tag reader or a barcode reader, and theattribute of the detected object is detected using the attributeinformation. For example, it is possible to read the aforementionedattribute information electromagnetically by irradiating a circuit inthe IC tag with an electromagnetic wave, or optically byimage-recognizing the barcode. Incidentally, a reading form ispreferably of noncontact type; however, it may be also of a contacttype. In any cases, it is possible to read the attribute informationusing the tag device, and it is possible to improve the rendering effectand interactivity on the basis of the read attribute information.

In an aspect in which the tag device is further provided, the positiondetecting device may detect the position of the detected object bydetecting where a position of the tag device attached to the detectedobject is in the real space portion.

According to this aspect, as described later, if a barcode reader or anIC tag reader is used that is specialized for the detection of the tagdevice, it can detect the position in addition to the attribute, so thatit serves a dual purpose. In other words, where the position of the tagdevice attached to the detected object is in the real space portion isdetected by the position detecting device, such as an IC tag and abarcode, and this allows the position of the detected object to bedetected. Specifically, if an electromagnetic wave is emitted toward theIC tag, the position of the detected object is detected from itsresponse time and response direction. In this manner, it is possible toreceive the effect that the dual purpose is served as described above.Incidentally, by attaching a plurality of tag devices to the detectedobject, the direction may be detected in addition to the position of thedetected object. At this time, since the floating image can be changedin accordance with not only the position but also the direction, theinteractivity of the floating image is further improved.

In an aspect in which the tag device is further provided, in addition tothe attribute information, status information indicating a status of thedetected object may be recorded readably in an electromagnetic-opticmanner in the tag device, and the image display apparatus may be furtherprovided with a rewriting device for rewriting at least the statusinformation.

According to this aspect, as described later, if a barcode reader or anIC tag reader is used that is specialized for the detection of the tagdevice, it can detect the status in addition to the attribute, so thatit serves a dual purpose. In other words, in the tag device, the statusinformation indicating the status of the detected object is alsorecorded readably in an electromagnetic-optic manner in addition to theattribute of the detected object. Then, at least the status informationis rewritten by the rewriting device, such as an IC tag writer or abarcode writer. For example, if the switch of the toy gun is changedfrom OFF to ON, the status information recorded in the IC tag isrewritten from the content indicating OFF to the content indicating ON.Then, the rewritten status information is detected by the statusdetecting device, and the “floating image of the target” is changed tothe “floating image of the target with the bullet hole”, as describedabove. In this manner, it is possible to receive the effect that thedual purpose is served, as described above, so that it is extremelyuseful in practice.

In another aspect of the image display apparatus of the presentinvention, the image transmitting device is provided with a microlensarray, and the floating image is displayed as a real image of the image.

According to this aspect, as described later, since the floating imageis the real image, there is no sense of discomfort even if the detectedobject (e.g. knife) is disposed at the position of the floating image.Thus, direct interactive can be provided for the floating image. Inother words, firstly, the image transmitting device is formed of amicrolens array. The “microlens array” herein is constructed in the 3Dfloating vision method, and it is constructed by unifying one or aplurality of lens array halves, each including a plurality of microconvex lenses arranged in a two-dimensional matrix. According to such animage transmitting device, the floating image is displayed as the realimage of the image (preferably, erected image).

Incidentally, a different method from the image display apparatus of thepresent invention can also realize a naked-eye stereoscopic system;however, unlike the image display apparatus of the present invention, itis hard to touch the floating image with the hand without a sense ofdiscomfort.

As the method of realizing the stereoscopic system without usingexclusive glasses, there are a view-angle barrier method, a lenticularmethod, and the like, as representative examples; however, stereoscopicvision is realized by a virtual image which is caused by showing aright-eye image to the right eye and by showing a left-eye image to theleft eye in any of the methods, and the focal position of the eyes ofthe observer is different from a position at which the floating image isperceived. In other words, in seeing the vision which emerges in frontof the image display surface, although the focal position of the eyes isplaced on the imaged display surface, the stereoscopic vision whichemerges in front is actually perceived. (This is said to causeeyestrain.) Hence, if the detected object (e.g. knife) is brought closeto the stereoscopic vision to touch, the focal position of the eyes isdisplaced from the image display surface to the position of the detectedobject which is to touch the stereoscopic vision (virtual image). Thus,it is hard to accurately visually recognize the floating image.

Thus, in the vision-angle barrier method and the lenticular method,there is a sense of discomfort in no small way in cases where thefloating image is directly touched.

In contrast, the floating image displayed by the image display apparatusof the present invention is the real image formed by the microlensarray, and the focal position of the eyes is placed on the position ofthe floating image from the beginning. Thus, even if the detected objectis brought to the position of the floating image, it is possible toeasily recognize that it is touched directly without a sense ofdiscomfort.

As explained above, according to the image display apparatus of thepresent invention, it is provided with the displaying device, the imagetransmitting device, the attribute specifying device, and thecontrolling device. Thus, it is possible to display the stereoscopictwo-dimensional image, relatively easily, and it is also possible toimprove the rendering effect and interactivity.

The operation and other advantages of the present invention will becomemore apparent from the embodiments explained below.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a perspective view showing the basic structure of an imagedisplay apparatus which can display a floating image in an embodiment.

FIG. 2 is a view showing the image display apparatus in the embodiment,viewed from A-A in FIG. 1.

FIG. 3 is a cross sectional view schematically showing the structure ofan image transmission panel.

FIG. 4 is a cross sectional view schematically showing the structure ofthe image transmission panel and the direction of the image (twopieces).

FIG. 5 are cross sectional views schematically showing the structure ofthe image transmission panel and the direction of the image (a: onepiece, b: three pieces).

FIG. 6 is a block diagram conceptually showing the basic structure of animage display apparatus in a first embodiment.

FIG. 7 is a flowchart showing the basic operation of the image displayapparatus in the first embodiment.

FIG. 8 is a schematic diagram for explaining the basic operation of theimage display apparatus in the first embodiment (a toy gun 120 a: doesnot exist, b: exists)

FIG. 9 is a block diagram conceptually showing the basic structure of animage display apparatus in a second embodiment.

FIG. 10 is a flowchart showing the basic operation of the image displayapparatus in the second embodiment.

FIG. 11 are perspective views for explaining statuses before and after atoy bullet passes through an image formation surface on the imagedisplay apparatus in the second embodiment (a: before passing, b: afterpassing in a comparison example, c: after passing in the secondembodiment).

FIG. 12 are side views for explaining the statuses before and after thetoy bullet passes through the image formation surface, on the imagedisplay apparatus in the second embodiment (a: before passing, b: afterpassing in the comparison example, c: after passing in the secondembodiment).

FIG. 13 are schematic diagrams showing that a fork is stuck into thefloating image, on the image display apparatus in the second embodiment(a: a perspective view, b: a front view showing a change in the floatingimage).

FIG. 14 are schematic diagrams showing that the floating image is cutwith a knife, on the image display apparatus in the second embodiment(a: a perspective view, b: a front view showing a change in the floatingimage).

FIG. 15 are schematic diagrams showing that the movement of the knife ispredicted and the floating image is foreseen when the floating image iscut with the knife, on the image display apparatus in the secondembodiment (a: a case where it is cut along a route P0-P1, b: a casewhere it is cut along a route Q0-Q1).

FIG. 16 is a block diagram conceptually showing the basic structure ofan image display apparatus in a third embodiment.

FIG. 17 is a flowchart showing the basic operation of the image displayapparatus in the third embodiment.

DESCRIPTION OF REFERENCE CODES

-   1 image display apparatus-   11 display device-   111 image display surface-   13 floating image-   15 space-   17 image transmission panel-   21 image formation surface-   23 micro convex lens-   231, 232 micro convex lens-   24 transparent substrate-   25 microlens array-   251, 252 lens array half-   112 display drive device-   17 image transmission panel-   60 attribute detection device-   100 control apparatus-   101 control device-   102 image generation device-   103 memory device-   120 toy gun-   121 toy bullet-   122 fork-   123 knife-   124 lipstick-   125 dryer-   126 brush-   50 to 56 IC tag-   31 audio output device-   32 audio drive device-   61 position detection device-   62 status detection device-   55 rewriting device

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, the best mode for carrying out the invention will beexplained in each embodiment in order, with reference to the drawings.

(Basic Principle)

Firstly, before the explanation of an image display apparatus inembodiments, the basic structure of the image display apparatus whichcan display a floating image will be explained with reference to FIG. 1and FIG. 2. FIG. 1 is a perspective view showing the basic structure ofthe image display apparatus which can display a floating image in anembodiment. FIG. 2 is a view showing the image display apparatus in theembodiment, viewed from A-A in FIG. 1.

As shown in FIG. 1, an image display apparatus 1 in the embodiment isprovided with a display device 11 having an image display surface 111;and an image transmission panel 17, and it displays a floating image 13on an image formation surface 21 in a space 15 on the opposite side tothe display device 11. Incidentally, in the embodiment, the displaydevice 11 corresponds to one example of the “first displaying device” ofthe present invention, and the image transmission panel 17 correspondsto one example of the “image transmitting device” of the presentinvention.

The display device 11 is, for example, a color liquid crystal displayapparatus (LCD). The display device 11 is provided with a color liquidcrystal drive circuit (not illustrated), a backlight illumination device(not illustrated), and the like, and it displays a two-dimensional imageon the image display surface 111. The color liquid crystal drive circuitoutputs a display drive signal on the basis of a video signal inputtedfrom the exterior. The backlight illumination device illuminates theimage display surface 111 from the rear if the display device 11 is notof a spontaneous luminescence type. The image display surface 111displays the two-dimensional image, for example, by changing thedirection of liquid crystal molecules and increasing or decreasing lighttransmittance, on the basis of the outputted display drive signal.Incidentally, the displayed two-dimensional image is eventuallydisplayed as the floating image, so that it is preferably drawnstereoscopically to have depth effect. As the display device 11, variousdisplay apparatuses, such as a cathode-ray tube, a plasma display, or anorganic electroluminescence display, may be used instead of the colorliquid crystal display apparatus (LCD).

The image transmission panel 17 is formed of, for example, a microlensarray (which will be detailed later with reference to FIG. 3), as shownin FIG. 2, and it is alienated from the display device 11. Moreover, theimage transmission panel 17 allows the light emitted from the imagedisplay surface 111 of the display device 11 (i.e. the display lightwhich constitutes the two-dimensional image) to form an image on theimage formation surface 21 in the space 15, to thereby display thefloating image 13. Here, the image formation surface 21 is a planevirtually set on the space in accordance with the operation distance ofthe microlens array, and it is not a real object. Back in FIG. 1, thefloating image 13 formed on the image formation surface 21 is displayedwith it floating in the space, and thus, for a viewer, it looks like astereoscopic image is displayed. In other words, the floating image 13is recognized for the viewer as a pseudo stereoscopic image. In order tostrengthen this tendency, the two-dimensional image displayed on thedisplay device 11 may be provided with depth in advance, or the contrastof the two-dimensional image may be emphasized by blacking thebackground image on the image display surface 111.

As described above, since the image display apparatus 100 is constructedas shown in FIG. 1 and FIG. 2, it is possible to display the floatingimage 13 on the image formation surface 21 as if the stereoscopic imagewere displayed.

Next, with reference to FIG. 3 to FIG. 5, the detailed structure of theimage transmission panel 17 will be explained. FIG. 3 is a crosssectional view schematically showing the structure of the imagetransmission panel. FIG. 4 is a cross sectional view schematicallyshowing the structure of the image transmission panel and the directionof the image (two pieces). FIG. 5 are cross sectional viewsschematically showing the structure of the image transmission panel andthe direction of the image (a: one piece, b: three pieces).

As shown in FIG. 3, the image transmission panel 17 is formed of amicrolens array 25.

The microlens array 25 is formed, for example, by unifying two pieces oflens array halves 251 and 252.

Each of the lens array halves 251 and 252 has a plurality of microconvex lenses 23 arranged in a two-dimensional matrix on the both sidesof a transparent substrate 24, which is made of glass or resinsexcellent in light transmittance. Each micro convex lens is disposedsuch that each of the optical axes of micro convex lenses 231 arrangedon one side of the transparent substrate 24 matches respective one ofthe optical axes of micro convex lenses 232 located at opposed positionson the other side. In addition, the lens array halves are overlapped soas to match the optical axes of the adjacent micro convex lenses 232 and231 between the lens array halves 251 and 252.

Moreover, the image transmission panel 17 is placed a predeterminedclearance (operating distance of the microlens array 25) away from andopposed to the image display surface 111 of the display device 11.

Therefore, the image transmission panel 17 transmits the display lightof the two-dimensional image, emitted from the image display surface 111of the display device 11, to the space 15 on the opposite side to thedisplay device 11 and forms an image on the image formation surface 21which is a predetermined distance away from the image transmission panel17. As a result, the image transmission panel 17 can display thetwo-dimensional image displayed by the display device 11, as thefloating image 13.

Here, as shown in FIG. 4, the two-dimensional image displayed by thedisplay device 11 is vertically reversed once on the lens array half251, and again reversed once on the lens array half 252 before it isemitted. By this, the image transmission panel 17 can display theerected image of the two-dimensional image, as the floating image 13.

Incidentally, if the erected image can be obtained as the floating image13, the structure of the microlens array 25 is not limited to what thetwo pieces of lens array halves 251 and 252 are unified as a pair. Forexample, it may be formed of one piece as shown in FIG. 5( a), or it maybe formed of two or more pieces as shown in FIG. 5( b).

As described above, if the image transmission panel 17 is constructed asshown in FIG. 3 to FIG. 5, the image display apparatus 100 canpreferably display the floating image 13, for example, as the erectedimage.

(1) First Embodiment

Next, with reference to FIG. 6 to FIG. 8, an explanation will be givenon the structure and the operation process of the image displayapparatus in the first embodiment, which can display the floating imageon the basis of the basic principle described above.

(1-1) Structure

Firstly, the structure of the image display apparatus in the embodimentwill be explained with reference to FIG. 6. FIG. 6 is a block diagramconceptually showing the basic structure of the image display apparatusin the first embodiment.

As shown in FIG. 6, the image display apparatus 1 in the embodiment isprovided with the display device 11, the image transmission panel 17, anaudio output device 31, an audio drive device 32, an attribute detectiondevice 60, and a control apparatus 100. Incidentally, in the embodiment,the attribute detection device 60 corresponds to one example of the“attribute specifying device” of the present invention, and the controlapparatus 100 corresponds to one example of the “controlling device” ofthe present invention.

The display device 11 is, for example, a color liquid crystal displayapparatus, and it is provided with the image display surface 111 and adisplay drive device 112. The display drive device 112 outputs a displaydrive signal on the basis of a video signal inputted from the controlapparatus 100, and it displays a two-dimensional image which is a motionpicture or a still image on the image display surface 111.

The image transmission panel 17, as described above using FIG. 1 to FIG.4, is disposed on the optical path of the display light whichconstitutes the two-dimensional image displayed on the screen of thedisplay device 11, and it transmits the display light of the displaydevice 11 so as to display a real image (i.e. the floating image) of thetwo-dimensional image on the image formation surface 21, which islocated in a space on the opposite side to the screen of the displaydevice 11. In this manner, 3D image display or stereoscopic imagedisplay is performed by the 3D floating vision method. For example,viewed from an observer located in front of the screen of the displaydevice 11 through the image transmission panel 17, the real image isseen as if it was floating on the image formation surface 21 on thefront side of the image transmission panel 17.

The audio output device 31 is, for example, a speaker, and it generatesan audible sound by changing a music signal inputted from the audiodrive device 32 to machine vibration.

The attribute detection device 60 is an image recognizing apparatus oran IC tag reader or the like, and it detects the attribute of a detectedobject which exists in its detectable range (e.g. several cm to severaltens cm). The detected object herein is, for example, a toy gun 120, afork 122, a knife 123, a lipstick 124, a dryer 125, or a brush 126, andit is preferably an instrumental object having a unique attribute (e.g.a shape, a function, a concept, or the like). The attribute detectiondevice 60 detects the attribute unique to the detected object in variousmethods. For example, if the attribute detection device 60 is providedwith an imaging element, such as a CCD camera, the attribute may bedetected by verifying the image of the detected object imaged with theimages of tools accumulated with the attributes in an image database inadvance. In particular, it is easy to detect the attribute by limitingthe number of candidates which can be detected in advance.Alternatively, if the attribute detection device 60 is the IC tagreader, the attribute may be detected by attaching unique attributeidentification IC tags 50 to 56 to the respective detected objects andby reading the IC tag, as shown in FIG. 6. The “IC tag” herein is ageneric term of a small information chip which is several microns toseveral millimeters square, and it corresponds to one example of the“tag device” of the present invention. In the IC tag circuit, a slightamount of electric power is generated by an electric wave emitted fromthe IC tag reader, and the electric power allows information to beprocessed and to be transmitted to the reader. In most cases, the IC tagand the IC tag reader need to be closer, due to a relation with theoutput of the electric wave to be used or the like; however, they arenot necessarily in contact with each other.

The control apparatus 100 is provided with a control device 101, animage generation device 102, and a memory device 103. Incidentally, inthe embodiment, the memory device 103 corresponds to one example of the“memory device” of the present invention, and the control apparatus 100corresponds to one example of the “predicting device” of the presentinvention.

The control device 101 is provided with, for example, a known centralprocessing unit (CPU), a read-only memory (ROM) for storing a controlprogram therein, a random access memory (RAM) for storing various datatherein, and an arithmetic-logic circuit, centered on a memoryapparatus, for storing and generating data for display image or thelike. The image generation device 102 generates data about displayimages or the like. The memory device 103 stores the attribute of thedetected object detected by the attribute detection device 60; an imageand a sound displayed in accordance with the attribute; or a history ofthe position associated to the detected object which is displaced; orthe like. The attribute of the detected object detected by the attributedetection device 60 is inputted to the control apparatus 100 as anelectric signal through a bus not-illustrated. On the other hand, itoutputs a video signal to the display drive device 112 or an audiosignal to the audio drive device 32.

(1-2) Operation

Next, the basic operation of the image display apparatus in theembodiment constructed in the above manner will be explained withreference to FIG. 7 and FIG. 8 in addition to FIG. 6. FIG. 7 is aflowchart showing the basic operation of the image display apparatus inthe first embodiment. FIG. 8 is a schematic diagram for explaining thebasic operation of the image display apparatus in the first embodiment(a toy gun 120 a: does not exist, b: exists)

In FIG. 7, firstly, the control apparatus 100 enables the imagegeneration device 102 to generate a two-dimensional image (originalimage) (step S101). For example, it is assumed, as shown in FIG. 8( a),that the original image is an image of a doll with a target.

Then, it is judged whether or not the attribute of the detected objectis detected by the attribute detection device 60 (step S102).

If the attribute of the detected object is not detected at all (the stepS102: NO), for example, if the detected object does not exist in thedatable range of the attribute detection device 60, there is no need toparticularly change the original image. Therefore, the original image ofthe doll is displayed to have a normal face or a smile, as shown in FIG.8( a).

On the other hand, if the attribute of the detected object is detected(the step S102: YES), the following process is performed in accordancewith the detected attribute. Incidentally, the case where the attributeof the detected object is detected is as follows: a case where a userhas a toy gun 120, which is one example of the detected object, in thedetectable range of the attribute detection device 60, and the IC tag 50with the attribute of the toy gun 120 written is read by the attributedetection device 60 to detect the attribute.

Firstly, a mask image corresponding to the detected attribute isgenerated by the image generation device 102 (step S103). Theassociation, i.e. what the mask image corresponding to the detectedattribute is like, is stored in advance in the memory device 103. Forexample, as shown in FIG. 8( b), the toy gun 120 is a tool for openingfire, so that a mask image depicting a status of “being scared” isassociated and stored. As examples of the mask images corresponding toother detected objects, the followings can be considered. The fork 122is a tool for sticking and rolling food, so that a mask image depictinga status of “being hungry” is associated and stored. The knife 123 is atool for cutting food, so that a mask image depicting a status of “beinghungry” is associated and stored. The lipstick 124 is a tool for wearinglipstick, so that a mask image depicting a status of “being happy” isassociated and stored. The dryer 125 is a tool for blowing hair with hotair, so that a mask image depicting a status of “feeling hot” isassociated and stored. The brush 126 is a tool for painting in variouscolors, so that a mask image depicting a status of “being excited” isassociated and stored.

Then, the original image and the mask image are combined (step S104).The control device 101 transmits a video signal to the display drivedevice 112 such that the combined two-dimensional image is displayed bythe display device 11. In response to the video signal, the displaydevice 11 displays the two-dimensional image after the combination (stepS105). Then, the display light which constitutes the displayedtwo-dimensional image is transmitted by the image transmission panel 17disposed on the optical path of the display light, and it is displayedas the real image on the image formation surface 21 through the imagetransmission panel 17 (step S106).

As described above, according to the embodiment, it is possible todisplay the stereoscopic two-dimensional image, relatively easily, andit is also possible to improve the rendering effect and interactivity.In particular, the attribute of the detected object can be detected, sothat not uniform but various reactions can be realized in accordancewith the attribute. Thus, the rendering effect as the stereoscopic imagebecomes enormous.

(2) Second Embodiment

An image display apparatus in a second embodiment will be explained withreference to FIG. 9 to FIG. 15.

(2-1) Structure

Firstly, the basic structure of the image display apparatus in theembodiment will be explained with reference to FIG. 9. FIG. 9 is a blockdiagram conceptually showing the basic structure of the image displayapparatus in the second embodiment.

Incidentally, in FIG. 9, the same constituents as those in theaforementioned first embodiment (i.e. FIG. 6) carry the same referencenumerals, and their explanation will be omitted as occasion demands.

In FIG. 9, the image display apparatus 1 in the embodiment is furtherprovided with a position detection device 61 for detecting the positionof a detected object, in addition to the constituents of the imagedisplay apparatus 1 in the first embodiment described above.Incidentally, the position detection device 61 corresponds to oneexample of the “position detecting device” of the present invention.

For example, if the toy gun 120 is fired and if the toy bullet 121 whichincorporates the IC tag 51 with the attribute written crosses the imageformation surface 21, the position detection device 61 can detect thecrossed planar area and transmit the detection result to the controlapparatus 100. The position detection device 61 is, for example, variousnoncontact sensors, a camera-type sensor, and the like. Incidentally,the planar area detected by the position detection device 61 does notnecessarily match the image formation surface 21, and it may be locatedbefore or behind the image formation surface 21.

Alternatively, the position detection device 61 can detect a spatialposition of the toy gun 120 in the detectable range in addition to orinstead of the planar area and can transmit the detection result to thecontrol apparatus 100. In this case, the position detection device 61may be replaced by, for example, various sensors such as a XYZ sensor, aCCD image sensor, disposed to capture the image formation surface fromthe front, an infrared sensor, or an ultrasound sensor, as well as asensor for detecting the planar areas arranged at predeterminedintervals. Alternatively, the detection result from one positiondetection device 61 may be temporarily accumulated in a memory built inor externally attached to the control apparatus 100, and the toy bullet121 which has passed through the image formation surface 21 may bedetected as a set of the planar areas.

Incidentally, the detection of the planar position and the detection ofthe spatial position as described above may be static or dynamic, and itis possible to adopt an aspect according to the application. In otherwords, the planar position and the spatial position may be detected fromthe shape of the detected object and position information registered inadvance in the memory, or they may be detected in real time by varioussensors such as a XYZ sensor.

(2-2) Operation

Next, the operation in the embodiment constructed in the above mannerwill be explained with reference to FIG. 10 in addition to FIG. 9. FIG.10 is a flowchart showing the basic operation of the image displayapparatus in the second embodiment.

In FIG. 10, firstly, the control apparatus 100 enables the imagegeneration device 102 to generate a two-dimensional image (originalimage) (the step S101). For example, it is assumed, as shown in FIG. 8(a), that the original image is an image of a doll with a target.

Then, it is judged whether or not the attribute of the detected objectis detected by the attribute detection device 60 (the step S102). If theattribute of the detected object is detected (the step S102: YES), it isfurther judged whether or not the position of the detected object isdetected by the position detection device 61 (step S211).

If the position of the detected object is detected (the step S211: YES),the following process is performed in accordance with the detectedposition and the attribute. Incidentally, the case where the position ofthe detected object and the attribute are detected is as follows: a casewhere the user fires the toy bullet 121, which incorporates the IC tag51 with the attribute written, toward the image formation surface 21with the toy gun 120, and as a result, the toy bullet 121 reaches in thedetectable range of the position detection device 61 and the attributedetection device 60.

Firstly, a mask image corresponding to the position of the detected toybullet 121 and the attribute is generated by the image generation device102 (step S203). Then, as in the first embodiment, the processes in thesteps S104, S105, and S106 are performed, and the floating image ispreferably changed in response to the position of the detected toybullet 121 and the attribute. This will be explained with reference toFIG. 11 and FIG. 12. FIG. 11 are perspective views for explainingstatuses before and after the toy bullet passes through the imageformation surface on the image display apparatus in the secondembodiment (a: before passing, b: after passing in a comparison example,c: after passing in the second embodiment). FIG. 12 are side views forexplaining the statuses before and after the toy bullet passes throughthe image formation surface, on the image display apparatus in thesecond embodiment (a: before passing, b: after passing in the comparisonexample, c: after passing in the second embodiment).

As shown in FIG. 11( a) and its side view, FIG. 12( a), it is assumedthat the toy bullet 121 is fired from the toy gun 120. At this time, thetoy bullet 121 passes through the floating image of the target,displayed on the image formation surface 21. If no measures are taken,there is a sense of discomfort as seen in FIG. 11( b) and its side view,FIG. 12( b). In other words, although the toy bullet 121 passes throughthe floating image of the target, there is no change in the floatingimage of the target, and thus there is a sense of discomfort.Alternatively, the interactivity is not felt.

Thus, in the embodiment, in order to remove the sense of discomfort, amask image of “a bullet hole” is generated on the basis of the attributeof the toy bullet 121, and the position of the “bullet hole” on theimage formation surface 21 is determined on the basis of the position ofthe toy bullet 121. As a result, as shown in FIG. 11( c) and its sideview, FIG. 12( c), if the user fires the toy gun 120 toward the floatingimage of the target displayed on the image formation surface 21, the“bullet hole” is left on the floating image of the target,simultaneously with or in tandem with that the toy bullet 121 passesthrough the image formation surface 21. Of course, if the position ofthe toy bullet 121 passing through the image formation surface 21 is offfrom the floating image of the target, the floating image of the targetis not particularly changed, and there is no “bullet hole” left. Asdescribed above, the floating image is significantly changed withrespect to the user's operation and the change varies depending on theused tool, i.e. the detected object. Thus, in addition to theinteractivity, reality also remarkably increases.

Incidentally, in FIG. 10, if the attribute of the detected object is notdetected at all (the step S102: NO), or if the position of the detectedobject is not detected at all (the step S211: NO), it is notparticularly necessary to change the original image. Alternatively, ifeither the position of the detected object or the attribute is detected,the floating image may be changed in accordance with the detectionresult.

(2-3) Other Examples

Next, with reference to FIG. 13 to FIG. 15, an explanation will be givenon how to change the floating image if other things other than the toybullet 121 are used as the detected object.

Firstly, with reference to FIG. 13, an explanation will be given on howto change the floating image if the fork 122 is used as the detectedobject. FIG. 13 are schematic diagrams showing that the fork is stuckinto the floating image, on the image display apparatus in the secondembodiment (a: a perspective view, b: a front view showing a change inthe floating image). Incidentally, the step numbers shown in FIG. 13( b)correspond to those in the flowchart in FIG. 10.

FIG. 13( a) depicts that a floating image of an apple is displayed onthe image formation surface 21 and that the user sticks the fork 122into the floating image of the apple. FIG. 13( b) shows a series ofchanges in the floating image at this time. Firstly, as shown in thestep S101 in FIG. 13( b), the floating image of the apple is displayedwithout any cut in the beginning. Then, if the user sticks the fork 122into the floating image of the apple, the planar area in which the fork122 crosses the image formation surface 21 is detected by the positiondetection device 61, and a mask image is generated at the positioncorresponding to the cross position, as shown in the step S203 in FIG.13( b). Incidentally, the mask image here is different from theaforementioned “bullet hole” (refer to FIG. 11), and it is a cut in arelatively low damaged condition, based on the attribute of the fork 122read from the IC tag 52. Lastly, by combining the mask image generatedin this manner and the original image, the floating image that the fork122 is stuck in the apple is obtained, as shown in the step S104 in FIG.13( b). A mask which is a predetermined margin larger than the crossedplanar area as shown in the step S203 in FIG. 13 is preferablygenerated. As described above, by providing a margin to some degree, itis possible to deal with a case where there are some difference in theview angle between the both eyes of an observer and where theobservation is performed at a position off from the front with respectto the formed image to a greater or lesser degree. Incidentally, themask image corresponding to the attribute of the fork 122 is notnecessarily one. A plurality of mask images may be selected by theposition of the fork 122 or a change in the position (i.e. movement).For example, if the position of the fork 122 changes only in the depthdirection, with the floating image as spaghetti, a mask image in thecondition that the spaghetti is “stung” is selected. On the other hand,if the fork 122 rotates with it crossing the image formation surface 21,more various representations can be performed by selecting a mask imagein the condition that the spaghetti is “rotated or wound around thefork”.

Next, with reference to FIG. 14, an explanation will be given on how tochange the floating image if the knife 123 is used as the detectedobject. FIG. 14 are schematic diagrams showing that the floating imageis cut with the knife, on the image display apparatus in the secondembodiment (a: a perspective view, b: a front view showing a change inthe floating image).

FIG. 14( a) depicts that a floating image of an apple is displayed onthe image formation surface 21 and that the user cuts the floating imageof the apple with the knife 123. FIG. 14( b) shows a series of changesin the floating image at this time. Firstly, as shown in a time pointt=0 in FIG. 14( b), the floating image of the apple is displayed withoutany cut in the beginning. Then, if the user cuts the floating image ofthe apple with the knife 123 and time has elapsed, mask images aregenerated at positions corresponding to a track drawn by the knife 123.Then, the floating images of the apple are obtained as shown in a timepoint t=T1 and a time point t=T2 in FIG. 14( b). Incidentally, the maskimages here are different from the aforementioned “bullet hole” (referto FIG. 11), and they are relatively sharp cuts based on the attributeof the knife 123 read from the IC tag 53. The reality is furtherincreased by showing the inside of the apple in the cuts. Incidentally,when the knife 123 is displaced as described above, a real-time processmay be performed such that the generated mask follows the displacement.Alternatively, the planar area which crosses the image formation surface21 or a set of the spatial areas may be stored in the memory device 103as the track, and a mask corresponding to the track may be generated.

As described above, when the knife 123 is displaced, the generated masknot only follows the current position of the knife 123 but also maypredict a destination, as shown in FIG. 15( a) and FIG. 15( b), to makepreparation, such as foreseeing the mask image in advance. FIG. 15 areschematic diagrams showing that the movement of the knife is predictedand the floating image is foreseen when the floating image is cut withthe knife, on the image display apparatus in the second embodiment (a: acase where it is cut along a route P0-P1, b: a case where it is cutalong a route Q0-Q1).

As shown in FIG. 15( a), if the knife 123 is displaced in the lowerdirection of the screen along a path P0-P1 between the time point t=0and T1, it is predicted to be displaced in a direction of a point P2,which is directly under the point P1, at a subsequent time point t=T2.Alternatively, as shown in FIG. 15( b), if the knife 123 is displaced ina curve in the lower right direction of the screen along a path Q0-Q1between the time point t=0 and T1, it is predicted to be displaced in adirection of a point Q2, which is not directly under but on an extendedline of the curve, at a subsequent time point t=T2. The prediction canbe performed, for example, by recording its track every several hundredmilliseconds and by specifying a velocity vector. If the prediction isperformed to generate the mask image, a response delay is solved, andthe user's sense of discomfort can be reduced, to thereby furtherimprove the interactivity

Incidentally, in the aforementioned embodiment, it is also possible toenjoy such a change that switches one after another depending on theattributes of the fork and the knife which are shifted. Alternatively,it is also possible to enjoy such a new change that the fork and theknife are simultaneously held and the floating image is cut with theknife while the fork is stuck into the floating image.

Moreover, a few other examples in the aforementioned embodiment will beillustrated. For example, in the case of a detected object with anattribute of the lipstick 124 with respect to a floating image of awoman's face, if the lipstick 124 is brought close to and moved on thewoman's lips, the floating image is changed to a floating image ofputting some lipstick on the lips, or the woman's face is also changedto have a happy facial expression. If the lipstick 124 is brought closeto and is moved on the cheek, the woman's face may be changed to have anannoying facial expression, or the woman may also turn her face away.Moreover, it is also possible to enjoy putting on makeup in conjunctionwith detected objects with attributes such as foundation and eye shadow.Moreover, in the case of a detected object with an attribute of thebrush 126, if it is brought closer to and is moved on the imageformation surface, it is possible to draw a thick line with itssurroundings blurred, like paint. In the case of an attribute of afountain pen, a thin and sharp line can be drawn. In the case of anattribute of a blue pen, a blue line can be drawn, and in the case of ared pen, a red line can be also drawn.

As described above, according to the embodiment, it is possible todisplay the stereoscopic two-dimensional image, relatively easily, andit is also possible to improve the rendering effect and interactivity.In particular, in addition to the attribute of the detected object, theposition can be also detected, so that not uniform but various reactionscan be realized in accordance with the attribute and the position. Thus,the rendering effect as the stereoscopic image becomes enormous.

(3) Third Embodiment

The structure and the operation process of an image display apparatus ina third embodiment will be explained with reference to FIG. 16 and FIG.17.

(3-1) Structure

Firstly, the structure of the image display apparatus in the embodimentwill be explained with reference to FIG. 16. FIG. 16 is a block diagramconceptually showing the basic structure of the image display apparatusin the third embodiment.

Incidentally, in FIG. 16, the same constituents as those in theaforementioned first embodiment (i.e. FIG. 6) carry the same referencenumerals, and their explanation will be omitted as occasion demands.

In FIG. 16, the image display apparatus 1 in the embodiment is furtherprovided with a status detection device 62 and a rewriting device 55, inaddition to the constituents of the image display apparatus 1 in thefirst embodiment described above. Incidentally, the status detectiondevice 62 corresponds to one example of the “status detecting device” ofthe present invention. The rewriting device 55 corresponds to oneexample of the “rewriting device” of the present invention.

The status detection device 62 is, for example, an IC tag reader whichis the same as the attribute detection device 60, and it detects thestatus of the detected object by reading the IC tag 50 with the statuswritten in a wireless or wired manner. Incidentally, the “status of thedetected object” herein qualitatively or quantitatively indicates somestatus about the detected object. For example, it indicates adiscontinuous two-step status, such as the ON/OFF of a switch, acontinuous multistage status, such as low, middle, and high volume, orsimilar statuses.

The rewriting device 55 is, for example, an IC tag writer, and it canrewrite information recorded in the IC tag 50 by dynamically changingthe circuit of the IC tag, for example.

Incidentally, the aforementioned status detection is not necessarilythrough the IC tag. For example, if the status detection device 62 andthe rewriting device 55 can perform transmission and reception by wiredcommunication or wireless communication using electromagnetic waves witha predetermined frequency band, the status detection device 62 candetect the status of the detected object.

(3-2) Operation

Next, the operation in the embodiment constructed in the above mannerwill be explained with reference to FIG. 17 in addition to FIG. 16. FIG.17 is a flowchart showing the basic operation of the image displayapparatus in the third embodiment.

In FIG. 17, firstly, the control apparatus 100 enables the imagegeneration device 102 to generate a two-dimensional image (originalimage) (the step S101). For example, it is assumed, as shown in FIG. 8(a), that the original image is an image of a doll with a target.

Then, it is judged whether or not the attribute of the detected objectis detected by the attribute detection device 60 (the step S102). If theattribute of the detected object is detected (the step S102: YES), it isfurther judged whether or not the status of the detected object isdetected by the status detection device 62 (step S311).

If the status of the detected object is detected (the step S311: YES),the following process is performed in accordance with the detectedposition and the attribute. Incidentally, the case where the status ofthe detected object and the attribute are detected is as follows: a casewhere the user fires the toy gun 120, which incorporates the IC tag 50with the attribute of the detected object written, toward the imageformation surface 21 from the detectable range of the status detectiondevice 62 and the attribute detection device 60, and the rewritingdevice 55 rewrites the status of the IC tag 50 with the status of thedetected object written, from “Fire switch ON” to “Fire switch OFF” inaccordance with the fire. Alternatively, it is a case where therewriting device 55 electromagnetically transmits an indication of “Fireswitch ON” to the status detection device 62 in accordance with thefire.

Firstly, a mask image is generated that corresponds to the status of thedetected toy gun 120 and the attribute by the status detection device 62and the attribute detection device 60 (step S303). Then, as in the firstembodiment, the processes in the steps S104, S105, and S106 areperformed, and the floating image is preferably changed in response tothe status of the detected toy gun 120 and the attribute. As a result,the user fires the toy gun 120 toward the floating image of the targetdisplayed on the image formation surface 21, and simultaneously with orin tandem with the status of “Fire switch ON”, the “bullet hole” is lefton the floating image of the target.

Incidentally, in the step S105, timing to display the two-dimensionalimage after the combination may be after a predetermined interval, afterthe status of the detected object is changed. The predetermined intervalis obtained, for example, from the position of the toy gun 120 on thefire, or the like, in the aforementioned case.

Moreover, the mask image with respect to the original image (e.g. theposition of the bullet hole) may be determined in view of a firing anglein addition to the position of the toy gun 120 on the fire. At thistime, the firing angle may be obtained by attaching a plurality of ICtags to a plurality of points on the toy gun 120 (preferably, on astraight line along a firing direction) and by detecting the position ofeach IC tag. Alternatively, the firing angle may be directly recognizedby an imaging element. Moreover, the firing angle and the firingdirection may be obtained by providing the toy gun 120 with a six-axissensor (e.g. acceleration in the XYZ direction, longitudinalinclination, lateral inclination, lateral swing) and by detecting thedirection, inclination, and movement of the toy gun 120.

Incidentally, in FIG. 17, if the attribute of the detected object is notdetected at all (the step S102: NO), or if the status of the detectedobject is not detected at all (the step S311: NO), it is notparticularly necessary to change the original image. Alternatively, ifeither the status of the detected object or the attribute is detected,the floating image may be changed in accordance with the detectionresult.

Moreover, a few other examples in the embodiment will be illustrated.For example, in the case of a detected object with an attribute of thedryer 125 with respect to a floating image of a woman's face, if thestatus of the dryer 125 is switched OFF, there is no particular changein the floating image. If the status of the dryer 125 is changed to beswitched ON, the floating image is changed to a floating image of awoman's face with flowing hair. Moreover, if an intensity switch for anair volume, which is one status of the dryer 125, is changed, the hairflowing degree may be changed. Moreover, by detecting the direction,angle, position, and movement of the dryer 125, the position and statusof the flowing hair may be also changed partially. Moreover, there maybe a change that the wet hair is dried with time.

As described above, according to the embodiment, the floating image issignificantly changed with respect to the user's operation, and thechange varies depending on the used tool, i.e. the detected object.Thus, in addition to the interactivity, reality also remarkablyincreases. At this time, the change can be made in accordance with theuser's operation even without detecting a strict position, and theinteractivity is improved.

Incidentally, in the aforementioned embodiments, the attribute,position, status, and the like of the detected object may be detected byarbitrarily combining the aforementioned various methods, procedures,and means. In this manner, in accordance with the specification of theimage display apparatus, it is possible to detect the necessaryinformation, appropriately or accurately. For example, all theinformation such as the attribute, the position, and the status may beexchanged at a time by wireless communication with the detected objectwhich incorporates a memory and a six-axis sensor.

Incidentally, the present invention is not limited to the aforementionedembodiments, but may be changed, if necessary, without departing fromthe scope or idea of the invention, which can be read from all theclaims and the specification thereof. The image display apparatus withsuch a change is also included in the technical scope of the presentinvention.

INDUSTRIAL APPLICABILITY

The image display apparatus of the present invention can be applied toan image display apparatus for stereoscopically displaying thetwo-dimensional image on the basis of the 3D floating vision method, forexample.

1-10. (canceled)
 11. An image display apparatus comprising: a displayingdevice for displaying an image on a screen; an image transmitting devicewhich is disposed on an optical path of display light which constitutesthe image and which transmits the display light which constitutes theimage so as to display a real image of the image as a floating image onan image formation surface located in a space on an opposite side to thescreen; an attribute specifying device for specifying an attribute of adetected object located in a real space portion including the space; anda controlling device for controlling said displaying device to changethe floating image into a form which is associated with the specifiedattribute of the detected object in advance, wherein said attributespecifying device has an attribute detecting device for detecting theattribute, said image display apparatus further comprises a tag devicewhich is attached to the detected object and in which attributeinformation indicating the attribute of the detected object is recordedreadably in an electromagnetic-optic manner, and said attributedetecting device detects the attribute by reading the recorded attributeinformation in an electromagnetic-optic manner.
 12. An image displayapparatus comprising: a displaying device for displaying an image on ascreen; an image transmitting device which is disposed on an opticalpath of display light which constitutes the image and which transmitsthe display light which constitutes the image so as to display a realimage of the image as a floating image on an image formation surfacelocated in a space on an opposite side to the screen; an attributespecifying device for specifying an attribute of a detected objectlocated in a real space portion including the space; and a controllingdevice for controlling said displaying device to change the floatingimage into a form which is associated with the specified attribute ofthe detected object in advance, wherein said image display apparatusfurther comprises a position detecting device for detecting where theposition of the detected object is in the real space portion, saidcontrolling device controls said displaying device to change thefloating image into a form which is also associated with the detectedposition of the detected object in advance, in addition to the specifiedattribute, said image display apparatus further comprises a memorydevice for storing a track of the position of the detected objectchanged, if the detected position of the detected object changes withtime, said controlling device controls said displaying device to changethe floating image into a form which is also associated with the storedtrack of the position of the detected object in advance, in addition tothe specified attribute, said image display apparatus further comprisesa predicting device for predicting where the position of the detectedobject is changed to in the real space portion, on the basis of thestored track of the position of the detected object, and saidcontrolling device controls said displaying device to foresee the imagein a form which is also associated with the predicted position of thedetected object in advance, in addition to the specified attribute. 13.The image display apparatus according to claim 11, wherein said imagedisplay apparatus further comprises a status detecting device fordetecting a status of the detected object, and said controlling devicecontrols said displaying device to change the floating image into a formwhich is also associated at least with the detected status of thedetected object in advance, in addition to the specified attribute. 14.The image display apparatus according to claim 12, wherein said imagedisplay apparatus further comprises a tag device which is attached tothe detected object and in which attribute information indicating theattribute of the detected object is recorded readably in anelectromagnetic-optic manner, and said position detecting device detectsthe position of the detected object by detecting where a position ofsaid tag device attached to the detected object is in the real spaceportion.
 15. The image display apparatus according to claim 11, whereinin addition to the attribute information, status information indicatinga status of the detected object is recorded readably in anelectromagnetic-optic manner in said tag device, and said image displayapparatus further comprises a rewriting device for rewriting at leastthe status information.
 16. The image display apparatus according toclaim 11, wherein said image transmitting device comprises a microlensarray, and the floating image is displayed as a real image of the image.17. The image display apparatus according to claim 11, wherein theattribute is uniquely associated with the detected object, and theattribute indicates at least a shape of the detected object.
 18. Theimage display apparatus according to claim 12, wherein said imagedisplay apparatus further comprises a status detecting device fordetecting a status of the detected object, and said controlling devicecontrols said displaying device to change the floating image into a formwhich is also associated at least with the detected status of thedetected object in advance, in addition to the specified attribute. 19.The image display apparatus according to claim 12, wherein said imagetransmitting device comprises a microlens array, and the floating imageis displayed as a real image of the image.
 20. The image displayapparatus according to claim 12, wherein the attribute is uniquelyassociated with the detected object, and the attribute indicates atleast a shape of the detected object.